Expected Improvements for the Asynchronous Parallel Global Optimization of Expensive Functions: Potentials and Challenges
نویسندگان
چکیده
Sequential sampling strategies based on Gaussian processes are now widely used for the optimization of problems involving costly simulations. But Gaussian processes can also generate parallel optimization strategies. We focus here on a new, parameter free, parallel expected improvement criterion for asynchronous optimization. An estimation of the criterion, which mixes Monte Carlo sampling and analytical bounds, is proposed. Logarithmic speed-ups are measured on 1 and 9 dimensional functions.
منابع مشابه
Parallel expected improvements for global optimization: summary, bounds and speed-up
The sequential sampling strategies based on Gaussian processes are widely used for optimization of time consuming simulators. In practice, such computationally demanding problems are solved by increasing number of processing units. This has therefore induced extensions of sampling criteria which consider the framework of parallel calculation. This report further studies expected improvement cri...
متن کاملParallel radial basis function methods for the global optimization of expensive functions
We introduce a master–worker framework for parallel global optimization of computationally expensive functions using response surface models. In particular, we parallelize two radial basis function (RBF) methods for global optimization, namely, the RBF method by Gutmann [Gutmann, H.M., 2001a. A radial basis function method for global optimization. Journal of Global Optimization 19(3), 201–227] ...
متن کاملParallel Bayesian Global Optimization of Expensive Functions
We consider parallel global optimization of derivative-free expensive-to-evaluate functions, and proposes an efficient method based on stochastic approximation for implementing a conceptual Bayesian optimization algorithm proposed by [10]. To accomplish this, we use infinitessimal perturbation analysis (IPA) to construct a stochastic gradient estimator and show that this estimator is unbiased.
متن کاملHealth Improvements for a Healthy Shanghai Rising; Comment on “Shanghai Rising: Health Improvements as Measured by Avoidable Mortality since 2000”
The commentator suggests that it is necessary to extend the classical connotation of global city which focuses much on the functions of controlling global capital and production. Global city should also include the dimensions of the leading role and capacity on health improvements and well-being promotion. The commentator agrees with authors’ assessments about Shanghai’s substantial progress o...
متن کاملA Modified Discreet Particle Swarm Optimization for a Multi-level Emergency Supplies Distribution Network
Currently, the research of emergency supplies distribution and decision models mostly focus on deterministic models and exact algorithm. A few of studies have been done on the multi-level distribution network and matheuristic algorithm. In this paper, random processes theory is adopted to establish emergency supplies distribution and decision model for multi-level network. By analyzing the char...
متن کامل